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SUMMARY 


This paper describes the design of a control system using linear-quadratic- 
regulator (LQR) control law theory for time invariant systems in conjunction 
with an "incremental gradient" procedure. The incremental gradient technique 
is used to reduce the full-state feedback controller design, generated by the 
LQR algorithm, to a realizable controller design. With a realizable controller, 
the feedback gains are based only on the available system outputs instead of 
being based on the full-state outputs as with the LQR approach. The controller 
design is for a remotely piloted research vehicle (RPRV) stability augmentation 
system. Included in the design are methods for accounting for noisy measure- 
ments, discrete controls with zero-order-hold (ZOH) outputs, and computational 
delay errors. Results from simulation studies of the response of the RPRV to 
a step in the elevator and frequency analysis techniques are included to illus- 
trate the abnormalities and their influence on the final controller design. 


INTRODUCTION 

This paper describes the use of linear-quadratic regulator (LQR) theory 
for time invariant systems to design a stability augmentation system (SAS) 
for a remotely piloted research vehicle (RPRV) . Classical control theory based 
designs for this aircraft have had marginal results, partly because of the 
design problem having multiple inputs and partly because of the controller 
having to be implemented with a digital computer. This paper designs a SAS for 
an RPRV with a design methodology that accounts for noisy measurements, discrete 
controls with zero-order-hold (ZOH) outputs, and computational delay errors. 

There has been considerable attention in the past to the use of LQR theory 
for the design of control systems. (See refs. 1 to 3.) In general, these 
designs require the full state to be measured or reconstructed from the avail- 
able outputs and used in the control system. Although it may be theoretically 
possible to obtain the full state, more often than not, as the complexity of 
the problem increases, the ability to obtain the full state becomes impossible; 
for example, the active control flutter models are of the order of 100 states. 

Recently, there has been a methodology developed (ref. 4) that retains the 
generality of quadratic optimization while resulting in a control system that 
is realizable. The term realizable is used here to mean a control system that 
employs feedback gains only on the available outputs, instead of being based on 
the full state as with the LQR approach. 

The design process is divided into two stages. The first step is identical 
with the LQR procedure. The designer, in an iterative process, adjusts the cost 
functions until the desired closed-loop control system response is obtained. 

Once this objective is achieved, the design is reduced to a realizable form with 
the use of an "incremental gradient" procedure. This procedure can be regarded 
as a two-point boundary-value problem in the gain state space, the initial 
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conditions being the LQR algorithm gains and the terminal conditions being 
the desired controller configuration, that is, with gains on inaccessible 
states equal to zero. 
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SYMBOLS 

system matrix 

defined in equation (A10) 

duiwny variable 

sensor output, normal acceleration, g 
rigid-body system matrix (eq. (4)) 
control input matrix (eq. (5)) 
control response matrix 
statistical expectation 
defined in equation (A1 1 ) 
control input matrix 
disturbance input matrix 
state response matrix 
quadratic performance indices 

state optimal feedback gain matrix 
defined by equation (A18) 
gains on selected measurements 
gains on eliminated measurements 
measurement matrix 
Lagrange multipliers 
symmetric weighting matrix 
defined in equation (A12) 
aircraft pitch rate, rad/sec 
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sensor output, q, rad/sec 
control weighting matrix 
response covariance matrix 
design response vector 
augmented design response vector 
measurement response vector 
= {e[(x - E(x)) 2 ]} 1/2 
Laplace transform 
time, sec 
matrix trace 

control input vector (eq. (2)) 

aircraft perturbation from steady-state velocity, m/s 

sensor output, v, m/s 

state covariance matrix 

rigid body state vector (eq. (4)) 

system state vector 

gust state 

z transform 

aircraft perturbation in angle of attack, rad 
sensor output, angle of attack, rad 
canard position, rad 
canard command, rad 

elevator position, positive for trailing edge down, rad 
elevator command, rad 
inboard flap position, rad 
inboard flap command, rad 



Sfo outboard flap position, rad 

^fo,c outboard flap command, rad 

n unit variance white noise vector 

Tl] f ri2 elements of vector 

0 aircraft perturbation in pitch angle, rad 

0 S sensor output, 0, rad 

p scalar design parameter 

a real part of eigenvalue 

T time constant 

<j) phase angle, deg 

a) frequency of input signal 

co s sampling frequency, rad/sec 

Dots over symbols denote derivatives with respect to time. 

A primed symbol denotes a transpose. 


PROBLEM STATEMENT 

The problem considered in this report consists of the design of a stability 
augmentation system (SAS) for a 0.44-scale model of an advanced fighter remotely 
piloted research vehicle (RPRV) . The RPRV is launched from the wing of a B-52 
airplane, controlled from the ground station by a digital computer, and backed 
up by a chase airplane which is capable of safely returning the RPRV to base. 
This advanced fighter configuration has 10 independently controlled aerodynamic 
surfaces which are grouped into 5 longitudinal controls (that is, controls that 
produce motions in the vertical plane of the aircraft) and 5 lateral controls 
(that is, horizontal-motion-producing controls) . Because of its aerodynamic 
design, the vehicle is longitudinally unstable for a large part of its subsonic 
flight envelope. The purpose of this paper is to design a SAS that will sta- 
bilize the RPRV longitudinally and provide adequate flying characteristics. 

Since the design methodology is the same for each flight condition, only the 
longitudinal equation of motion for one flight condition is presented. The 
control must be implemented on a ground computer with sensor information being 
received and control commands being transmitted at a rate of 50 Hz. This sam- 
pling rate is fixed for the problem and is not considered a design variable. 

The time required to receive the data, to calculate the command, and to trans- 
mit the command to the RPRV is approximately the time of 1 cycle; thus, a 
1 -cycle delay (20 ms) is assumed between receiving the sensor signal and 
transmitting the control command. For the design model, sensors were assumed 
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to have sufficient bandwidth to permit them to be modeled with a unity transfer 
function. Sensor noise was modeled by shaping white noise through a first- 
order low-pass filter. Estimated sensor noise parameters, based on aircraft 
flight records (ref. 5) , are given in table I. The use of sensor noise 
characteristics based on flight data was deemed more appropriate since it 
includes the effects of instrument noise, aeroelastic effects, turbulence 
effects, engine vibration, etc., and would represent the worst-case situation. 

The design of the SAS for the entire flight envelope requires that the 
nonlinear equations of motion be linearized about several flight conditions, 
the design process applied at each of the conditions, and some procedure be 
defined for changing the control system parameters as a function of the flight 
condition. 

The linearized equations of motion in the longitudinal plane for the 
rigid body states of the RPRV in level flight at an altitude of 30 480 km 
(10 000 ft) and a Mach number of 0.9 are 
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where v is the perturbation from the steacty-state velocity in meters per 
second; a is the perturbation in angle of attack in radians; q is the pitch 
rate in radians per second; 0 is the perturbation in pitch angle in radians; 
6 e , 6 f i / 6 C , an<a 6fo are tlie ©levator, inboard flap, canard, and outboard 

flap position in radians. The fifth longitudinal command, the speed brake, was 
omitted because of its ineffectiveness, as compared with the other controls. 

The open-loop pole locations are shown in figure 1 . The control actuators are 
represented by first-order 40-radian actuators with unity static gain. By com- 
bining the rigid-body states with the actuator states, the basic RPRV equations 
of motion can be written as 


x = Ax + G*ju 

(2) 

r 2 = Mx 

(3) 
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In these equations, x is the system state vector with the following 
definitions: 
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Velocity, m/s 
Angle of attack, rad 
Pitch rate, rad/sec 
Pitch angle, rad 
Actuator position, rad 
Actuator position, rad 
Actuator position, rad 
Actuator position, rad 


u is the control input vector with the following definitions: 
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Elevator command , rad 
Flaps- inboard command, rad 
Canard command, rad 
Flaps-outboard command, rad 


and t 2 is the measurement response vector with the following definitions 
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Velocity, m/s 
Angle of attack, rad 
Pitch rate, rad/sec 
Pitch angle, rad 
Normal acceleration, g 
Actuator position, rad 
Actuator position, rad 
Actuator position, rad 
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The system matrix A, the control input matrix G-| , and measurement matrix M 
are 


Matrix A 



1 -Column 

2-Column 

3-Column 

4 -Column 

5-Column 

6-Column 

7-Column 

8-Column 

1 -Row 

—0 .4508E— 01 

-0.6762E+02 

-0.7431 E+02 

-0.1054E+03 

0.3032E+03 

-0.1 944E+03 

0.9094E+01 

-0 . 3556E+02 

2-Row 

.21 42E-04 

— . 2498E+01 

. 9870E+00 

-.7683E-03 

- . 1 388E+02 

-.7456E-01 

. 3703E+00 

- . 1 362E+01 

3 -Row 

— . 6060E-3 

.7241 E+02 

3803E+01 

.11 87E-02 

-.341 4E+04 

-.1 961 E+04 

.6843E+03 

-.4722E+03 

4 -Row 

0 

0 

.1 000E+01 

0 

0 

0 

0 

0 

5 -Row 

0 

0 

0 

0 

-. 4000E+02 

0 

0 

0 

6 -Row 

0 

0 

0 

0 

0 

- .4000E+02 

0 

0 

7 -Row 

0 

0 

0 

0 

0 

0 

-, 4000E+02 

0 

8-Row 

0 

0 

0 

0 

0 

0 

0 

- . 4000E+02 

Matrix 

G 









1 -Column 

2-Column 

3-Column 

4 -Column 





1 -Row 

0 

0 

0 

0 





2-Row 

0 

0 

0 

0 





3-Row 

0 

0 

0 

0 





4 -Row 

0 

0 

0 

0 





5 -Row 

. 1 000E+01 

0 

0 

0 





6-Row 

0 

. 1 OOOE+Ol 

0 

0 





7 -Row 

0 

0 

. 1 OOOE+Ol 

0 





8 -Row 

0 

0 

0 

.1 000E+01 





Matrix 

M 









1 -Column 

2-Column 

3-Column 

4-Column 

5-Column 

6-Column 

7-Column 

8 -Column 

1 -Row 

0.3040E+00 

0 

0 

0 

0 

0 

0 

0 

2-Row 

0 

.1 000E+01 

0 

0 

0 

0 

0 

0 

3 -Row 

0 

0 

. 1 OOOE+Ol 

0 

0 

0 

0 

0 

4 -Row 

0 

0 

0 

0.1 000E+01 

0 

0 

0 

0 

5-Row 

. 1 969E-05 

-. 7533E+02 

-. 3930E+00 

. 1 406E-03 

-.41 85E+03 

-. 2249E+03 

.111 7E+02 

-.41 08E+02 

6-Row 

0 

0 

0 

0 

0 

.4000E+02 

0 

0 

7 -Row 

0 

0 

0 

0 

0 

0 

. 4000E+02 

0 

8 -Row 

0 

0 

0 

0 

0 

0 

0 

. 4000E+02 


As stated previously, the control system is to be implemented with a digital 
computer. Two approaches to synthesizing the discrete control system to be used 
in the computer can be taken: discrete digital synthesis or the conversion 

of a continuous design. Although the design methodology has a direct analogy 
for the discrete equations and could be used to design a discrete controller, 
the conversion of a continuous design to a discrete controller was used for this 
report. 


DESIGN RESPONSE SELECTION 

The cost function used in this design was formulated from the rate of the 
implicit model following error response. If the rigid body (subscript RB) and 
the implicit model (subscript m) equations are given by 


xrb = a RB x RB + Bu 


(4) 
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x m ~ A m x m + Bu 


(5) 


then the rate of residual can be defined as 
d 

*1 = — < X RB - x m) 


( 6 ) 


and is given by 


*1 _ A RB X RB " A m x m 


(7) 


Assuming that the rigid body and model states are close together 


x m * X RB 


( 8 ) 


yields 


*1 = ( a RB _ AmJxRB 


(9) 


The implicit model was chosen so that the short-period response had a critical 
damping ratio of 0.707 and a natural frequency of 3 rad/sec. The implicit 
phugoid model retained the RPRV's natural frequency (0.15 rad/sec), but had an 
increased critical damping ratio of 0.7. These values can be compared with the 
open-loop pole locations in figure 1 . 

The objective is to find an implicit model of similar form except that the 
roots of the characteristic equation result in these performance specifications. 
Extracting the short-period approximation from equation (1 ) (that is, assuming 
the velocity constant) and dropping the 0 equation yields 


*JRB 


-2.498 0.987 

[_72.41 -3.803J 


a 


l - q -iRB 


( 10 ) 


If the elements of the a equation are assumed to be identical in both 
the model and vehicle, then the remaining terms of the model can be specified. 
This requires the solution of the following equation: 
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s + 2.498 


-0.987 


(ID 


-A-, 


s - A 2 


s 2 + 2(0.707) 3s + 3 2 


Performing the required calculations for A-j and A 2 results in the following 
short-period implicit model: 


m 


*2.498 

-4.703 


0.987 

-1.745 


( 12 ) 


m 


An identical procedure can be used to calculate the phugoid implicit model 
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( 13 ) 


By using this implicit model for the short- period and phugoid motion and enforc- 
ing the kinematic constraint that the pitch angle 0 is equal to the integral 
of the pitch rate q, it follows directly from equation (9) that the design 
responses are 


r l = 
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(14) 


DESIGN EXAMPLES 

Several design models are presented and discussed to illustrate the dif- 
ferent controller designs generated by each design model and to gain insight 
as to why the form of the final design model was chosen. The details of the 
methodology for the method used in this report are given in the appendix. The 
design process begins with the basic airplane as described by equations (2) 
and (3) augmented with the elevator being driven with filtered zero mean 
Gaussian noise. The elevator was chosen for the injection of the noise because 
it produced sufficient root mean square (rras) levels on all the states. Expe- 
rience has shown that if the injected noise does not excite the system suffi- 
ciently, the incremental gradient procedure may not converge. 
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Basic Design Model 


In the full-state feedback LQR solution, the characteristics of the noise 
process do not affect the resultant gains. However, in the reduced state 
feedback case, the calculated gains are dependent on these characteristics 
(that is, the eigenvalues of the shaping filter with respect to the eigenvalues 
of the open-loop system) . Since the design objective of this controller is a 
stability augmentation system, it is only necessary to place the eigenvalues 
of the noise filter outside a circle which is centered at the origin and which 
encloses the eigenvalues of the open-loop systems that are important. An 
additional constraint in solving the Riccati equation (eq. (A9)) requires that 
the initial eigenvalues be stable; therefore, the location of the noise filter 
pole was chosen on the negative real axis at 50 radians. However, if the design 
objective were gust alleviation, the gust filter would be based on an approxi- 
mation of atmospheric turbulence. The rms output of the noise was arbitrarily 
adjusted to 0.1 radian. The structure of the basic design model is illustrated 
in figure 2. 

By using the design response as defined by equation (14) with the matrix R 
(eq. (A1 6) ) equal to the identity matrix, full-state feedback gains were calcu- 
lated for several values of p. These results are presented in figure 3. The 
asymptotic behavior of the roots approaching Butterworth patterns is illustrated 
as p approaches zero. For large values of p the cost function is equivalent 
to a cost function known as the "minimum pseudo-energy." It is characterized 
by reflecting all unstable eigenvalues about the imaginary axis while not dis- 
turbing the stable eigenvalue locations. For a value of p of 0.5 x 10®, the 
unstable root at 0.5 radian has been rotated about the imaginary axis and the 
damping of the phugoid has been increased to a critical damping ratio of 0.7. 

The full-state feedback gains are presented in table II. Since stable eigen- 
values on the real axis yield satisfactory handling qualities and since weight- 
ing the control tends to minimize the control rms required to stabilize the 
system, the minimum pseudo-energy was considered to be appropriate. Also, 
large p values are expected to result in smaller gain values. 

An interesting observation can be made by noting that for this value of 
p, and in fact for any value of p, implicit model following is not achieved. 
Implicit model following is never obtained because the differences between the 
desired model and the plant are large enough to render equation (8) invalid. 

The fact to be noted is that although the design did not minimize the cost as 
it was anticipated, the control law produced was good. 

By using this form of the weighting matrix and the design model as shown 
in figure 2, the incremented gradient procedure was applied. The output feed- 
back gains are shown in table III and the closed-loop eigenvalues can be 
compared with the open-loop eigenvalues in figure 1 . The unstable root at 
5 radians has been rotated about the imaginary axis and the damping of the 
phugoid has been increased to a critical damping ratio of 0.7. The response 
of the closed-loop linear system with the basic gains to a negative 0.1 -radian 
step in the elevator command is illustrated by the time history of the pitch 
rate and elevator position in figure 4(a). 
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The response of the system is that of a well-damped 0 command system. 

This is the predicted result of the response of the linear equations of motion 
of an aircraft to a step in the elevator, pitch angle being feedback. This 
response may not be the one that is desired for the aircraft, but it is an 
acceptable response for a SAS. Control laws designed in a similar manner can 
be added to modify this controller design for other control tasks, such as 
pitch rate command. The pitch rate does not return to zero because the linear 
equations were used in the simulation. 

Figure 4 represents the time history of the response of the RPRV to a 
negative step in the elevator command, with and without simulated noise being 
added to the sensors. The upper half of the figure represents the response of 
the vehicle to the step command with no noise added to the sensor measurements, 
whereas the lower half is the response of the vehicle with noise, modeled by 
first-order low-pass filters with the parameter of table I, added to the sen- 
sors. In the lower left quadrant, the response of the pitch rate and elevator 
position have been significantly changed by the addition of noise to each of 
the sensor measurements. Since the design model did not account for the noise 
on the measurement, the gains that were obtained do nothing to attenuate the 
noise; thus, the response of the aircraft is undesirable in a noisy environment. 


Design Model for Noise 

In order to overcome this undesirable response, or at least minimize the 
effect of the noise, the design model was augmented as shown in figure 5. To 
each of the output signals, filtered noise was added at an intensity level 
equal to the calculated rms output of the assumed first-order filter of the 
observed flight records. The resulting gains from the design process are given 
in table IV. Comparing these gains with those in table III indicated an overall 
reduction in magnitude, with some gains being reduced greater than others. In 
particular, the gain of the angle-of-attack sensor a s has been reduced sig- 
nificantly. This was to be expected since the rms output of this sensor was 
the largest. The most surprising result was a sign change on the normal accel- 
eration a z gains. There is no logical explanation for this result. A plau- 
sible reason for this difference could be in the numerical accuracy of the 
gradient algorithm used in the design procedure. The eigenvalues of the closed- 
loop system can be compared with the basic design in figure 1 • The major dif- 
ference in the roots is the combining of the actuator root with a short-period 
root to form an oscillatory root with a critical damping ratio of 0.7 and a 
natural frequency of 30 rad/sec. This is not considered an unreasonable demand 
on the actuator since it is within the response of the open-loop actuator. The 
response of the pitch rate due to a step response in the elevator for this con- 
trol design can be compared with the identical simulation with the gains of 
table II in figure 4. The major differences between the closed-loop system 
responses are (1) the apparent short-period critical damping ratio has been 
decreased to about 0.7, and (2) the amount of noise transmitted by the SAS has 
been reduced. 
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Digital Implementation 


Implementing control laws with a digital computer requires some form of 
digital-to-analog conversion. The most widely used method is the zero-order 
hold (ZOH) . The degrading effects of using a ZOH are illustrated by a fre- 
quency response analysis in figure 6. The general nature of the degrading 
effects of the ZOH is the added phase lag in the low frequency range. In 
this figure the gain and phase characteristics of a ZOH without and with dis- 
crete compensation are plotted against the frequency of the input signal gj 
divided by the frequency of the sampler. 

Hartmann, Hauge, and Hendrick (ref. 6) have proposed using the phase lead 
compensator depicted in figure 6 to improve these undesirable characteristics 
of the ZOH. In order to minimize these characteristics, this digital com- 
pensator was implemented in the control design, and a time history analysis of 
the closed-loop system was performed. The time histories did not indicate any 
change with or without the compensator being in the loop. This can be attrib- 
uted to good gain and phase margins that accompany full state LQR design that 
have carried over to the partial state design. 

In order to illustrate the effects of the compensator, a frequency analysis 
was performed on the continuous closed-loop system and the discrete closed-loop 
system with and without the ZOH compensator in the loop. The difference between 
these systems is shown in figure 7. In figure 8, the frequency response of the 
pitch rate q due to the system being excited with the elevator can be com- 
pared for the system with the basic gains and the system with the gains that 
have been designed for noisy measurements. Figure 9 compares the closed-loop 
frequency response effect of using the discrete ZOH phase lead compensator. 

This analysis indicated that the effects of the ZOH on the closed-loop 
system are compensated for with the Z-domain transfer functions in figure 6, 
although these effects are not very strong. It is worth noting that this 
compensator for the ZOH has one major disadvantage, a pole in the left half of 
the Z-plane which produces an oscillation with a period of twice the sampling 
rate on the output. In this particular use, the oscillation did not produce 
any undesirable effects, but that is not to say that it could be used satis- 
factorily in all cases. 


Design Model for Delay 

The design model can be modified to account for the 1 -cycle delay intro- 
duced by the digital implementation by including a filter representing a Pade 
approximation on the output of each actuator. This design model is shown in 
figure 10 with first-order functions used to represent the delay. The design 
process was repeated with several different order Pade approximations until 
the introduction of a higher order delay model did not change the resulting 
gains from the previous design model. For this example, the first-order 
approximation shown in figure 10 was sufficient to design the control system. 
These gains are presented in table V. A frequency analysis of the closed-loop 
system including a 1 -cycle delay with the gains in tables IV and V can be com- 
pared in figure 11. As in the previous example, the differences between the 



two systems is not great, but these examples illustrate methods for including 
the effects of the digital delay in the design model. In doing so, the result- 
ing controller can be made to compensate for this delay. In this example, the 
compensation resulted in a shift of the amplitude ratio curve to the left, or 
to put it another way, the system low frequency gain was increased. 


CONCLUSIONS 

This paper presented a realizable optimal control system design for an RPRV 
from modern control theory design methodologies. The design methods for includ- 
ing noisy measurements, discrete controllers with zero-order-hold computational 
delay errors, and for finding design responses to achieve implicit model follow- 
ing have been presented in a design example for a remotely piloted research 
vehicle. Some important conclusions and results of this study are 

1. The results of modern control theory design can be used to obtain 
realizable controller designs. 

2. The effects of undesirable effects (i.e., noisy measurements, etc.) can 
be accounted for in the design model. 

3. The robustness of LQR designs, in this example, was carried over into 
the realizable design. 

4. An acceptable system was obtained although model following was not 
achieved. 


Langley Research Center 

National Aeronautics and Space Administration 
Hampton, VA 23665 
March 17, 1980 
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APPENDIX 


DESIGN METHODOLOGY 

The theory and numerical techniques used in the design procedure are doc- 
umented in references 7 to 9 and, therefore, will only be summarized here. 
Given the time invariant linear system 


: Ax + G*| u + G 2 n 

(A1) 

= Hx + Du 

(A2) 

= Mx 

(A3) 


where x is the system state vector (including rigid-body states, actuator and 
servo states, sensor states, model following states, and wind states) , u is 
the control input vector, and n is a unit-intensity white noise vector. The 
design response vector r-| is a vector of elements that have been chosen so 
that when the squares of the elements are minimized, the desired performance of 
the system is obtained. The states, or linear combinations of the states, of 
the system which can be measured and are to be used in the final control system 
design are the elements of the measurement response vector r 2 . The design 
methodology has two stages. Initially, a stabilizing control law of the form 


u = Kx 


(A4) 


is found which minimized the performance index 


J - E( ri 'Qr-j ) = tr [QR-j ] 


(A5) 


where E is the statistical expectation and Q is a symmetric weighting 
matrix. The matrix R-| is the asymptotic response covariance matrix, defined 
as 


R-j * E(r-jr-| ') = (H + DK)X(H + DK) ' 


(A6) 


where X is the asymptotic state covariance matrix. The closed-loop asymp- 
totic state covariance matrix is the solution to 


(A + G-] K) X + X (A + G-, K) ' + G 2 G 2 ' = 0 


(A7) 
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APPENDIX 


The full-state feedback gain matrix K is found by appending this covariance 
equation to J by a Lagrange multiplier matrix P and solving for the optimal 
(K,P,X) set which minimizes the augmented cost function. The resulting optimal 
gains K are 

K = - (D'QD) “1 [G-j 'P + D'QH] 


(A8) 

The Lagrange multiplier matrix P is found by solving the matrix Riccati 
equation 


A'P + PA - PEP + Q = 0 


(A9) 

where 



A = A - G-| [d , QD]“ 1 D , QH 


(A10) 

i = G-, [D , QD]" 1 G 1 ' 


(All) 

Q = H'QH - H'QD[D'QD] -1 D'QH 


(A12) 

Insight into how to choose the matrices H and D 
can be obtained by examining the preceding problem 

and weighting matrix 
with the constraint 

Q 

D'QH = 0 


(A13) 

Reformatting the problem by substituting equation 
substituting the resulting equation into equation 

(A8) into equation (A4) 
(A5) results in 

and 

J - E(r-j 'r-j + u'Ru) 


(A14) 

where 



r = qV2h x 


(A15) 

R = D’QD 


(A16) 


When R is replaced by pR, where p is a scalar design parameter, Harvey, 
Stein, and Doyle in reference 10 have shown that as p tends to zero, the poles 
of the closed-loop response matrix A - G-] (R)“^G-j 'P approach either (a) the 
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closed-loop transmission zeros that have negative real parts or the left half- 
plane mirror images of the zeros in the right half-plane, or (b) they approach 
infinity in multiple Butterworth patterns with different growth rates. Parti- 
tioning the matrices H and D so that equation (A13) is valid allows the 
elements of the Q matrix to individually control the effect of either equa- 
tion (A15) or the control functions defined by the D matrix on the design. 
Increasing the weight on a response function (or control function) results in 
the rms of that function relative to the rms of the other functions to be 
lowered. By using a set of response functions, the requirement of finding the 
proper weights on the states is transformed into finding a smaller set of 
weights on the response functions. These response functions may have conflict- 
ing effects on each other; decreasing one particular function may tend to 
increase the response of other functions. By adjusting the weights on these 
functions, the performance of the design can be adjusted until a compromise 
solution is obtained to the controller design. 

This formulation of the LQR problem has three advantages: 

(1) The problem of choosing the quadric weights is reduced to that of 
finding a smaller set of design responses. These design responses may be 
intuitive from the design objective. 

(2) The weights on the controls R are chosen to regulate the relative 
control motion with respect to each control; that is, the allowable maximum for 
control u-] may be different than the allowable maximum for control U2« 

(3) The scalar parameter p can be considered a gain adjustment. As p 
tends to zero, the elements of the gain matrix K increase. 

The design cycle consists of forming a design response r-| , selecting the 
relative control weights R, and solving equations (A8) and (A9) for several 
values of the scalar parameter p. This design cycle is repeated until the 
performance of the system meets the design goals. 

Once the designer is satisfied with the closed-loop performance of the 
system, an "incremental gradient" procedure is used in the second stage of the 
design procedure to reduce the full-state feedback control system to a reduced 
state or realizable control system. The full-state gain matrix represents the 
starting point for the "incremental gradient" procedure and, therefore, need 
not be calculated with this procedure. The initial gains can be calculated 
with any procedure as long as equation (A5) is minimized and the control law 
is of the form of equation (A4) . 

In the incremental gradient procedure, the measurement gains are written 
as a function of a scalar parameter X so that 


u = K* (X) x 


(A17) 
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where 

K*(X) = K-, (X) M + XK 2 

By assuming M has maximal rank K* (1 ) is defined as 
K* (1 ) = K-, (1 ) M + K 2 
where K-j (1 ) is defined as 
K-] (1 ) = KM' (MM') -1 


(A18) 


(A19) 


(A20) 


and K is the full-state feedback matrix from equation (A4) and 

K 2 = K[l - M' (A21 ) 


The procedure determines the gain for use in equation (AT 7) as K*(X) which is 
obtained by gradually letting X move from X = 1 to X = 0 while maintaining 


9J 

9K q (X) 


(A22) 


with J a quadratic performance index of the form (A5) using the control law 
of equation (A17). Explicit details can be found in reference 10. 


17 


REFERENCES 


1. Kwakernaak, Huibert; and Sivan, Raphael: Linear Optimal Control Systems. 

John Wiley & Sons, Inc., c.1972. 

2. Anderson, Brian D. 0.; and Moore, John B.: Linear Optimal Control. 

Prentice-Hall, Inc., c.1971. 

3. Kirk, Donald E.: Optimal Control Theory - An Introduction. Prentice- 

Hall, Inc., c.1970. 

4. Konar, A. F.; Stone, C. R. ; Mahesh, J. K.; and Hank, M. : Active Control 

Synthesis for Flexible Vehicles. Volume 1 - KONPACT Theoretical Descrip- 
tion. AFFDL-TR-75-1 46 , U.S. Air Force, June 1976. (Available from DTIC 
as AD B015 198L.) 

5. Elliott, Jarrell R. : NASA's Advanced Control Law Program for the F-8 

Digital Fly-by-Wire Aircraft. IEEE Trans. Autom. Control, vol. AC-22, 
no. 5, Oct. 1977, pp. 753-757. 

6. Hartmann, Gary L; Hauge, James A.; and Hendrick, Russell C.: F-8C Digital 

CCV Flight Control Laws. NASA CR-2629, 1976. 

7. Konar, A. Ferit: Development of Weapon Delivery Models and Analysis Pro- 

grams. Volume I - System Modeling and Performance Optimization. 

AFFDL-TR- 71 -1 23 , U.S. Air Force, Apr. 1972. (Available from DTIC as 
AD 751 505.) 

8. Stein, Gunter; and Henke, Allen H. : A Design Procedure and Handling-Quality 

Criteria for Lateral-Directional Flight Control Systems. AFFDL-TR-70-152, 
U.S. Air Force, May 1971 . 

9. Kowalik, J.; and Osborne, M. R. : Methods for Unconstrained Optimization 

Problems. American Elsevier Pub. Co., Inc., 1968. 

10. Harvey, C. A.; Stein, G. ; and Doyle, J. C.: Optimal Linear Control (Char- 

acterization of Multi-Input Systems). ONR CR 215-238-2, U.S. Navy, 

Aug. 1977. (Available from DTIC as AD A043 771.) 


18 


TABLE I.- NOISE PARAMETERS 


Sensor 

x, sec 

Intensity 

Root mean square 

v s 

0.16 

0.61 m/sec 

1 . 08 m/sec 

“s 

0.005 

0.3° 

3.00° 

Ss 

0.08 

0 . 5 deg/sec 

1.25 deg/sec 

e s 

0.16 

0.3° 

0.35° 

a z 

0.008 

0. 06g 

0. 47g 


TABLE II.- PULL-STATE FEEDBACK GAINS 



V S' 

m/s 

“s' 

rad 

e S ' 

rad 

9s' 

rad 

a z' 

9 

rad 

rad 

5 fO' 

rad 

Xgf 

rad 

6 e,c' rad 

-0.0012 

2.366 

0.1130 

0.0762 

0.0195 

-0.0072 

0.0342 

-0.0079 

0.2039 

'SfirC' rad 

-0.0007 

1.356 

0.0647 

0.0435 

0.0112 

-0.0041 

0.0196 

-0.0045 

0.1168 

6 C/ c, rad 

0.0002 

-0.4599 

-0.0220 

-0.0115 

-0.0038 

0.0014 

-0.0067 

0.0015 

-0.0397 

6 f0rC , rad 

[-0.0002 

1 — 

0.3238 

0.0155 

0.0105 

0.0027 

-0.0010 

0.0049 

-0.0011 

0.0279 


TABLE III.- BASIC GAINS 



V S' 

m/sec 

Olg, 

rad 

0 S' 

rad 

<3s' 

rad/sec 

a z' 

9 

6 e,c' rad 

-0.0010 

2.054 

0.1060 

0.0668 

0.0160 

6 fi,C' rad 

-0.0006 

1.777 

0.0607 

0.0382 

0.0091 

6 C,C' rad 

0.0002 

j -0.3991 

-0.0206 

-0.0137 

-0.0031 

6 fO,C' rad 

-0.0001 

0.2810 

0.0145 

! 

0.0093 

0.0022 
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TABLE IV.- GAINS DESIGNED FOR NOISE 



v s' 

“s' 

6 s' ’ 

9s' 

a z' 


m/sec 

rad 

rad 

rad/sec 

g 

<5 e ,c' rad 

-0.0009 

0.0936 

0.1278 

0.1440 

-0.0038 

5 fi,c' rad 

-0.0005 

0.0530 

0.0733 

0.0827 

-0.0022 

6 CfC , rad 

0.0002 

-0.0179 

-0.0251 

-0.0301 

0.0007 

6 fo,c' rad 

-0.0001 

0.01 26 

0.0175 

0.0202 

-0.0005 

TABLE 

V.- GAINS DESIGNED FOR NOISE AND DELAY 


V S' 

Otg, 

9 S' 

<3s' 

a z . 


m/sec 

rad 

rad 

rad/sec 

g 

6 e,c' rad 

-0.0006 

0.0840 

0.1071 

0.0881 

-0.0043 

6 fi,c' rad 

-0.0004 

0.0475 

0.061 5 

0.0507 

-0.0025 

^c,c' rad 

0.0001 

1 

-0.0157 

-0.0212 

-0.0194 

0.0008 

6 fo,c' rad 

-0.0001 

0.0113 

• - 

0.0147 

0.0125 

-0.0006 
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O Open- 1 oop roots 
□ Desired closed-loop roots 
<> Closed-loop roots of basic gain 
A Closed-loop roots of gains for noise 
A Closed-loop roots of gains for noise delay 



characteristic equation for different 
:equency roots are not shown. 





m 










ffl 


0 


Time, t,sec 


nl 


Time, t, sec 


Time, t, sec 

(a) Response with basic 
gains - no noise. 


Time, t, sec 

(c) Response with gains designed for 
noise - no noise. 



3 . 00 4 . 50 

Time, t, sec 



- L . . ! 

3. 00 4 . 50 

Time, t, sec 


6 . 00 7 . 50 




Time, t, sec 

(b) Response with basic gains - 
noise on sensors. 


Time, t, sec 


(d) Response with gains designed for 
noise - noise on sensors. 


Figure 4.- Step response of pitch rate q and elevator position S e 
to a -0.1- radian step in elevator command for control design with 
and without sensor noise in the design model. 



Command 

inputs 



Figure 5.- Design model for 


measurements 















Figure 6.- Zero-order hold with and without phase lead compensation 






* 


(a) Continuous closed-loop frequency response. 



(b) Discrete closed-loop frequency response. 



(c) Discrete closed-loop frequency response with delay. 

Figure 7.- Frequency response models used to compare different control laws. 


* 
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